LOGISTICS  MATURITY  EVALUATOR 


REPORT  IR509R1  •  APRIL  2006 


James  H.  Reay 
A.  Jeffrey  Colaianni 
Evelyn  F.  Harleston 
Amy  Maletic 
John  G.  Marcus 


LMI 

RESEARCH  INSTITUTE 


ADVANCINGTHE  SCIENCE  OF  GOVERNMENT  MANAGEMENT 


The  views,  opinions,  and  findings  contained  in  this  report 
are  those  of  LMI  and  should  not  be  construed  as  an  offi¬ 
cial  agency  position,  policy,  or  decision,  unless  so  des¬ 
ignated  by  other  official  documentation. 


LMI 

Logistics  Maturity  Evaluator 

IR509R1/April2006 


Executive  Summary 


To  operate  effectively,  federal  civil  agencies  should  continuously  develop  new, 
more  integrated  logistics  systems  to  acquire,  maintain,  and  deliver  needed  equip¬ 
ment,  materials,  and  infrastructures  that  are  optimized  in  terms  of  investment  and 
benefits.  Agency  managers  generally  recognize  that  existing  logistics  systems  are 
not  as  effective  or  efficient  as  they  could  be;  however,  there  is  no  available  bench¬ 
mark  to  readily  assess  current  systems  without  significant  investment.  The 
challenge  is  to  reduce  the  costs  of  operations  and  support,  increase  workforce 
productivity,  reduce  costs  of  managing  inventory,  and  increase  the  effectiveness 
of  delivering  support  material  and  services.  To  achieve  these  objectives,  the  logis¬ 
tics  systems  of  each  agency  should  be  evaluated  to  determine  how  well  operations 
are  being  supported,  whether  meaningful  improvement  initiatives  are  planned  or 
in  place,  and  what  the  end  cost  will  be. 

LMI  wishes  to  help  government  logistics  managers  determine  the  current  state  of 
their  logistics  processes,  prioritize  resource  application,  and  identify  future  direc¬ 
tion.  To  do  so,  we  embarked  on  a  research  effort  to  develop  a  logistics  maturity 
evaluator  (LME).  By  accomplishing  this  independent  research  and  development 
task,  we  hope  to  develop  LMFs  analytical  capability  to  provide  a  structured  high- 
level  assessment  of  federal  agencies’  logistics  status,  progress,  and  proficiency 
and  help  agency  managers  target  areas  for  improving  performance  and  reducing 
support  costs. 

The  LME  borrows  heavily  from  the  capability  maturity  model  concept  being  ap¬ 
plied  in  many  organizations  to  meet  management’s  need  for  an  unbiased  assess¬ 
ment  tool.  Our  intention  is  to  develop  a  repeatable  system  that  gives  logistics 
managers  an  objective  comparison  of  the  present  status  of  their  agencies’  business 
processes  and  technologies  for  delivering  goods  and  services. 

We  completed  the  first  of  two  phases  for  this  research  task.  The  set  of  characteris¬ 
tics  and  evaluation  criteria  we  developed  can  be  used  as  a  standard  against  which 
managers  can  measure  an  agency’s  logistics  system. 


iii 


By  applying  the  LME  to  logistics  organizations,  government  managers  will  be 
able  to 

♦  determine  the  current  level  of  their  logistics  processes  in  terms  of 
modernization  and  implementation  of  improvements  and  technologies; 

♦  identify  additional  process  improvements  that  may  be  applicable  to 
their  organizations;  and, 

♦  based  on  the  collective  experience  of  similar  organizations,  identify 
likely  areas  for  focusing  business  process  reengineering  initiatives  to 
maximize  return  on  investment,  with  a  reasonable  expectation  of  success¬ 
ful  implementation  given  the  organization’s  current  level  of  development. 

For  the  purpose  of  assessing  logistics  maturity  in  government  agencies,  we  devel¬ 
oped  five  progressive  maturity  levels  and  identified  the  characteristics  of  related 
business  practices  within  each  level,  as  shown  in  Figure  FS-1. 

Figure  ES-1.  Logistics  Maturity  Pyramid 


Level  5 — Optimized  Integration 


Level  1 — Initial 
(Basic  practices) 


We  can  determine  an  agency’s  logistics  maturity  by  asking  key  logistics  person¬ 
nel  to  complete  an  evaluation  questionnaire.  Once  agency  personnel  complete  the 
survey,  individual  scores  are  aggregated  and  summarized  into  an  organizational 
score.  The  FME  process  produces  graphical  representation  of  the  composite  rank¬ 
ing  of  the  target  logistics  organization  on  the  level  1-5  maturity  scale.  Results  are 
compiled  and  compared  with  other  similar  agencies  or  matched  to  a  private  sector 
counterpart.  The  final  FME  report  to  agency  managers  includes  key  conclusions 
and  suggestions  for  next  steps. 
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Executive  Summary 


This  report  presents  the  results  of  our  researeh  in  Phase  I  and  the  produets  in¬ 
cluded  in  the  LME.  In  Phase  II,  we  plan  to  test  the  LME  capability  with  data  ob¬ 
tained  from  selected  government  civil  agency  logistics  managers  and  personnel. 
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Chapter  1 

Introduction  to  Logistics  Maturity 


By  developing  a  logisties  maturity  evaluator  (LME),  LMI  hopes  to  augment  our 
analytical  capability  to  provide  a  structured,  high-level  assessment  of  the  logistics 
status,  progress,  and  proficiency  of  federal  agencies  and  to  help  agency  managers 
identify  areas  for  improving  performance  and  reducing  support  costs.  Our  inten¬ 
tion  is  to  develop  a  repeatable  procedure  that  allows  logistics  managers  to  objec¬ 
tively  compare  their  organizations’  business  processes  and  technologies  with  a 
targeted,  optimized,  and  integrated  logistics  operation.  The  comparison  should 
help  managers  determine  where  to  place  emphasis  and  resources  to  achieve  higher 
levels  of  customer  service. 

Characterization  of  Logistics  Maturity 


There  are  two  phases  of  our  planned  approach  to  the  LME  development  task.  In 
Phase  I  we  developed  a  set  of  characteristics  and  evaluation  criteria  that  can  be 
used  as  a  standard  against  which  to  measure  an  agency’s  logistics  process  infra¬ 
structure.  ^  As  a  first  step,  we  identified  the  basic  elements  that  characterize  logis¬ 
tics  maturity.  These  are  shown  in  Eigure  1-1. 

Figure  1-1.  Components  of  Logistics  Maturity 


*  Our  development  work  was  influeneed  by  the  Software  Capability  Maturity  Model  (SW-CMM) 
eoneept  developed  by  the  Software  Engineering  Institute  at  Camegie-Mellon  University.  The  CMM 
is  addressed  in  Chapter  2. 
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We  then  identified  maturity  levels,  ineorporating  basic  and  improved  logistics 
processes  and  business  practices  that — at  the  highest  level  of  maturity — lead  to 
the  optimized  integration  of  an  organization’s  overall  logistics  system.  To  gather 
information  regarding  a  logistics  organization’s  current  status,  we  developed  an 
assessment  questionnaire  that  would  quantify  the  level  of  logistics  maturity.  Our 
questionnaire  incorporates  the  basic  components  of  logistics  maturity.  Details  of 
this  research  are  discussed  in  subsequent  chapters. 

In  Phase  II  of  the  LME  project,  we  will  exercise  the  LME  capability  in  live  tests 
with  selected  government  agency  logistics  managers  and  personnel. 

Value  of  Assessing  Logistics  Maturity 


An  organization’s  processes  define  how  it  works.  They  produce  the  desired  results 
and  provide  the  mechanism  to  incorporate  knowledge,  use  capabilities,  leverage 
resources,  and  ultimately  do  things  better. 

There  is  a  common  misconception  that  improved  results  are  a  certainty  if  an  or¬ 
ganization  has  really  good  people,  access  to  advanced  technology,  and  motivated, 
experienced  managers.  This  notion  is,  at  best,  naive.  Although  people  and  tech¬ 
nology  are  essential  to  achieving  organizational  objectives,  process  improvement 
is  equally  critical.  Private  sector  organizations  can  ultimately  look  at  profit-and- 
loss  statements  to  measure  success.  Government  activities  do  not  have  an  equally 
objective  measure  of  results  or  progress  toward  organizational  goals.  The  pursuit 
of  initiatives  is  often  disjointed  or  fragmented;  yet,  government  managers  are  con¬ 
tinuously  asked  to  assess  progress,  make  improvements,  and  become  more  effi¬ 
cient  and  effective. 

Unfortunately,  process  improvement  initiatives  in  government  activities  are  often 
ignored  or  even  feared  by  the  managers  charged  with  achieving  organizational 
goals  and  objectives.  Such  managers  often  focus  on  one  aspect  of  improvement 
(such  as  workforce  training  or  technology  application)  without  seeing  the  integrat¬ 
ing  function  accomplished  by  the  organization’s  business  processes.  They  equate 
the  term  “process”  with  bureaucracy,  inertia,  regimentation,  and  added  up-front 
costs.  Conversely,  these  managers — under  pressure  for  results — sometimes  initi¬ 
ate  process  change  without  a  clear  understanding  of  the  associated  process,  tech¬ 
nology,  and  workforce  in  attaining  long-term  direction  or  end-state  goals. 

In  process-oriented  areas  like  logistics,  failure  to  begin  with  an  integrated  “big 
picture”  view  of  functional  elements  inevitably  leads  to  failed  efforts  and  wasted 
resources.  To  help  government  logistics  managers  determine  the  current  state  of 
their  logistics  processes,  prioritize  resource  application,  and  identify  meaningful 
future  direction,  EMI  embarked  on  this  independent  research  effort  to  develop  a 
logistics  maturity  evaluator.  The  EME  borrows  heavily  on  the  capability  maturity 
model  concept  applied  by  many  organizations  around  the  world  to  meet  manage¬ 
ment’s  need  for  an  assessment  tool. 
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Introduction  to  Logistics  Maturity 


As  part  of  the  movement  in  government  to  make  funetional  proeesses  more  effi- 
eient  and  effeetive,  managers  are  often  eharged  to  analyze  and  adopt  private- 
seetor  praetiees  to  rapidly  improve  and  modernize  key  proeesses  like  logisties. 
Onee  national  leaders  in  logistics  management,  government  organizations  have 
fallen  behind  in  the  last  several  decades  in  implementing  innovative  processes, 
methods,  and  enabling  technologies.  As  costs  escalate  and  agencies  downsize, 
government  organizations  have  lost  the  analytical  capability  and  technical  knowl¬ 
edge  to  effect  large-scale  improvements.  Outsourcing  of  process  improvement 
implementation  and,  more  directly,  modernization  of  automated  systems  is  now 
the  only  option  for  government  managers  who  seek  significant  process  improve¬ 
ment.  But  these  managers  must  first  assess  the  current  status  and  establish  the  or¬ 
ganization’s  strategic  direction  before  committing  large-scale  resources  to  any 
particular  improvement  path. 

In  the  area  of  logistics,  the  private  sector  has  already  committed  to  substantial  re¬ 
search,  innovation,  business  process  reengineering,  and  technology  development  and 
implementation.  Many  of  these  private-sector  efforts  have  important  application  in 
the  public  sector,  but  government  managers  often  are  faced  with  too  many  “solu¬ 
tions,”  rather  than  too  few.  These  managers  will  find  the  LME  useful  as  they  attempt 
to  apply,  leverage,  and  prioritize  scarce  process  implementation  resources  so  the 
maximum  improvement  is  obtained  for  a  finite  level  of  investment. 

Using  the  LME,  managers  can  select  appropriate  process  improvement  tools  and 
initiatives  that  have  proven  successful  in  both  private  sector  and  government 
applications  and  that  are  most  applicable  to  their  specific  organizational  needs. 

Application  of  the  LME  to  logistics  organizations  will  allow  government  managers 
to  achieve  the  following: 

♦  With  a  modest  analytical  effort,  determine  the  current  level  of  their  logis¬ 
tics  processes  in  terms  of  process  modernization  and  implementation  of 
emerging  improvements  and  technologies. 

♦  Identify  additional  process  improvement  areas  that  may  be  applicable  to 
their  organization. 

♦  Based  on  the  collective  experience  of  similar  organizations,  identify  likely 
areas  for  business  process  reengineering  initiatives  to  maximize  return  on 
investment,  with  a  reasonable  expectation  of  successful  implementation 
given  the  organization’s  current  level  of  development. 
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Chapter  2 

Capability  Maturity  Models 


Improving  the  end  results  or  attaining  the  preseribed  goals  has  beeome  an  intrinsic 
objective  of  nearly  every  organization.  When  an  enterprise  wishes  to  improve  re¬ 
sults,  it  typically  focuses  on  three  factors:  people,  processes  and  methods,  and 
technology.  Processes  and  methods  generally  provide  the  capability  to  optimize 
available  people  and  technology  to  improve  output.  Manufacturing  industries 
have  long  recognized  that  improving  processes  is  an  important  way  of  meeting 
business  objectives.  In  service-oriented  industries,  such  as  logistics,  process  im¬ 
provement  is  also  accepted  as  a  means  to  better  results.  Unfortunately,  process 
change  is  difficult  to  define  and  implement  because  the  desired  objectives  may  be 
imprecise. 


Government  managers  must  move  their  agencies  toward  improved  results  in  a 
structured  manner,  with  well-defined  steps  and  quantifiable  targets.  This  approach 
permits  more  effective  course  adjustment  and  interim  measurement  of  success.  A 
meaningful  plan  of  action  and  milestones  is  essential  to  an  effective  improvement 
plan;  however,  organizations  often  are  not  well-versed  in  the  process  of  effective 
planning,  and  the  home-grown  action  plan  is  often  replete  with  false  starts,  non- 
essential  milestones,  and  dead-end  activities.  One  approach  to  avoiding  these  pit- 
falls  is  to  learn  from  the  mistakes  of  others  and  adopt  courses  of  action  that  have 
been  validated  by  previous  efforts.  Today,  through  the  application  of  various  auto¬ 
mated  process  analysis  tools,  we  can  document,  track,  and  assess  process  improve¬ 
ment  activities  in  ways  previously  considered  too  cumbersome  and  overly  resource 
intensive.  One  such  technique  is  a  capability  maturity  model  (CMM). 

What  is  a  capability  maturity  model?  Stated  simply,  it  is  a  structured  way  to  de¬ 
termine  the  levels  or  extent  of  an  organization’s  process  capabilities.  Within  the 
model,  organizational  progress  is  expressed  in  terms  of  the  degree  of  maturity, 
that  is,  from  ad  hoc,  immature  processes  to  disciplined,  mature  processes  with 
improved  quality,  efficiency,  and  effectiveness.  The  model  describes  an  evolu¬ 
tionary  improvement  path  that  documents  the  organization’s  progress  from  one 
maturity  level  to  the  next  higher  level. 

Current  CMMs  often  use  the  convention  of  five  maturity  levels — from  least  mature 
(level  1)  to  most  mature  (level  5).  These  maturity  levels  are  defined  based  on  the 
competency  achieved  as  an  organization  implements  specific  process  improve¬ 
ments.  For  example,  an  organization  may  achieve  maturity  level  1  by  automating 
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tasks  that  previously  were  aecomplished  manually.  Higher  levels  of  maturity  are 
attained  as  the  organization  integrates  proeesses  across  organizational  lines. ' 

By  recognizing  and  using  the  maturity  level  definitions  built  into  the  model,  man¬ 
agers  can  more  easily  determine  the  degree  of  process  improvement  being 
achieved.  CMM  usually  includes  an  increasing  scale,  as  shown  in  Figure  2-1. 

Figure  2-1  Capability  Maturity  Model 
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mature 


Maturity  level  5: 

Organization 
has  achieved 
its  process  goais, 
and  is  continuaiiy 
improving  them 


Maturity  level  1 : 

Efforts  typically  are 
ad  hoc  and  not  integrated 


The  first  CMM  model.  Software  CMM  (SW-CMM),  was  developed  in  the  early 
1990s  by  the  software  community  under  the  stewardship  of  the  Carnegie-Mellon 
University’s  Software  Engineering  Institute  (SEI).  The  Department  of  Defense 
funded  this  effort  and  continues  as  a  principal  participant  in  CMM  development.  To¬ 
day,  SEI  retains  oversight  of  CMM  development  efforts  worldwide,  acting  as  a  cen¬ 
tral  clearinghouse  and  model  repository  for  CMM  information,  providing  a  standard 
approach  for  appraising  proposed  capability  models,  and  conducting  CMM  training 
and  seminars.  SEI  has  also  led  the  evolution  of  CMM  to  a  broader  scope  by  integrat¬ 
ing  capability  maturity  models  across  such  disciplines  as  systems  engineering,  inte¬ 
grated  product  development,  and  acquisition.  This  effort  to  apply  capability  models 
across  disciplines  is  called  capability  maturity  model  integration  (CMMI). 

There  are  two  approaches  to  developing  and  using  capability  maturity  models: 
staged  representation  and  continuous  representation.  Either  approach  can  help 
managers  assess  the  level  of  maturity  currently  achieved  in  an  organization  or  the 
level  targeted  for  the  future. 

♦  Staged  representation  is  a  more  holistic  approach  in  which  the  CMM 
evaluation  focuses  on  the  level  of  maturity  attained  for  the  full  range  of 
processes  for  the  organization.  This  approach  is  often  used  when  man¬ 
agement  wishes  to  determine  the  maturity  level  of  the  entire  organization 
for  a  given  discipline.  We  incorporated  the  staged  representation  approach 
into  the  EME. 


*  We  describe  specific  maturity  levels  that  we  adopted  for  use  in  the  LME  in  Chapter  4. 
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Capability  Maturity  Models 


♦  Continuous  representation  measures  maturity  levels  separately  for  indi¬ 
vidual  proeesses  within  a  discipline.  In  this  case,  management  can  focus 
on  individual  areas  and  apply  priority  attention  to  processes  that  may  be 
problematic  or  are  likely  candidates  for  near-term  improvement. 

Regardless  of  which  representation  is  used,  the  same  basic  evaluation  criteria  are 
applied  to  assess  level  of  maturity.  Figure  2-2  illustrates  the  two  approaches  to 
CMM  representation. 

Figure  2-2.  Staged  Versus  Continuous  Representation 


Measures  overall  maturity 


Measures  process  maturity 


Although  the  majority  of  CMM  implementations  are  in  the  private  sector,  the  concept 
has  been  applied  to  government  activities.  For  example,  the  Federal  Aviation 
Administration  has  instituted  an  extensive  CMM  program  as  a  basis  for  business 
process  reengineering  across  the  agency.  The  Department  of  Defense  developed  an 
acquisition  CMM  for  application  to  military  weapons  and  equipment  programs. 

Our  research  indicates  there  is  noteworthy  similarity  between  target  processes  in 
the  private  sector  and  government  activities.  In  later  chapters,  we  focus  on  the  po¬ 
tential  for  use  of  the  CMM  concept  in  the  LME  as  a  process  evaluation  and  im¬ 
provement  tool  particularly  for  federal  civil  agencies. 
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Chapter  3 

Applying  CMM  to  Logistics 


As  described  in  Chapter  2,  the  concept  and  application  of  capability  maturity 
models  is  well  documented  and  a  widely  accepted  analytical  technique.  Our  re¬ 
search  effort,  therefore,  focused  on  the  application  of  the  CMM  method. 

In  this  IR&D  task,  we  addressed  three  specific  analytical  perspectives: 

♦  The  application  of  the  CMM  approach  to  the  area  of  logistics 

♦  The  construction  of  a  less-complex  approach  to  CMM  that  would  be  at¬ 
tractive  to  federal  government  civil  agency  senior  managers 

♦  An  assessment  method  tailored  to  government  logistics  organizations. 

Our  research  identified  a  number  of  functional  areas  (in  both  the  private  and  pub¬ 
lic  sectors)  in  which  CMM  had  been  applied.  By  using  the  repository  of  informa¬ 
tion  available  on  the  Software  Engineering  Institute  website,'  we  were  able  to 
determine  that  no  previous  CMM  efforts  had  focused  on  government  logistics. 

Our  research  also  indicated  that  a  CMM  approach  could  be  a  useful  tool  for  gov¬ 
ernment  managers  to  assess  the  level  of  development  and  status  of  their  logistics 
organizations  and  processes.  Use  of  CMM  requires 

♦  a  well  understood  set  of  business  functions  or  activities, 

♦  accepted  business  process  improvement  practices  that  are  recognized  by 
functional  managers  as  essential  to  achieving  organizational  objectives, 
and 

♦  an  acceptable,  viable  method  for  accomplishing  maturity  level  assessment. 

The  members  of  our  research  team  have  extensive  expertise  in  the  full  range  of 
functions  and  activities  that  comprise  the  logistics  process  within  government  and 
the  private  sector.  We  were  able  to  readily  document  the  scope  of  logistics  func¬ 
tions  that  should  be  incorporated  into  a  logistics  maturity  evaluator. 

Our  team  also  had  access  to  a  wide  body  of  reports,  research  papers,  web-based 
documentation,  and  other  sources,  which  permitted  us  to  compile  a  comprehensive 
list  of  logistics-oriented  business  process  improvement  practices.  We  were  able  to 
include  in  our  assessment  tool  a  range  of  generally  accepted  improvement  approaches 
that  could  help  assess  the  maturity  of  an  organization  being  evaluated. 

♦  SEI  website  is  http://www.sei.emu.edu/emmi/. 
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Developing  an  aeeeptable  way  to  assess  maturity  was  the  most  diffieult  element  of 
our  researeh  projeet.  Although  we  began  with  a  reasonably  good  knowledge  of  gov¬ 
ernment  logisties  funetions  and  generally  aeeepted  business  improvement  praetiees,  it 
was  not  elear  whether  the  CMM  approaeh  espoused  by  SEI  and  the  doeumented 
CMM  implementation  guidelines^  were  applieable  for  most  eivil  ageney  logisties 
organizations.  The  eharaeteristies  of  a  elassie  CMM  assessment  appeared  to  be  unae- 
eeptable  for  many  potential  eivil  ageney  logisties  elients.  As  an  example,  prior  CMM 
efforts  have  been  time  eonsuming,  manpower  intensive,  and  expensive.  As  a  result, 
ageney  managers  may  not  be  anxious  to  embark  on  a  full  CMM  assessment.  There¬ 
fore,  our  researeh  ehallenge  was  to  eonstruet  a  logisties  maturity  evaluation  approaeh 
that  ineorporated  the  essential  elements  and  diseipline  of  the  CMM,  but  required  only 
a  limited  resouree  eommitment,  whieh  is  more  attraetive  to  ageney  managers. 

Further,  a  rigid  applieation  of  existing  CMM  methodology  requires  substantial 
doeumentation  of  an  organization’s  individual  business  proeesses  with  a  high 
level  of  detail.  Sueh  effort  may  yield  signifieant  detailed  information  regarding 
the  day-to-day  funetioning  of  organizational  proeesses,  but  most  government 
managers  would  rather  obtain  a  more  summarized  assessment  of  their  organiza¬ 
tion’s  maturity  status — at  least  initially — in  order  to  foeus  on  an  ineremental  and 
evolutionary  proeess  improvement  initiative.  Figure  3-1  presents  the  basie  re¬ 
seareh  steps  we  took  to  develop  and  aeeomplish  a  logisties  maturity  evaluation. 

Figure  3-1.  Applying  CMM!  Concepts  to  Logistics  Organizations 


The  elassie  CMM  method  requires  a  periodie  reeertifieation  of  assessment  results. 
Our  researeh  approaeh  attempted  to  apply  the  basie  CMM  eoneept  while  provid¬ 
ing  a  “snapshot”  assessment  and  initial  foeus  on  a  summary  level  of  detail  and 
assessment. 

The  remaining  ehapters  of  this  report  deseribe  the  researeh  aeeomplished  to  eom- 
plete  the  steps  shown  above. 


^  Mary  Beth,  Chrissi  et  al.,  CMMI:  Guidelines  for  Process  Integration  and  Product  Improvement, 
Addison-Wesley  Publications,  September  2004. 
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Chapter  4 

Maturity  Levels  in  Government  Logistics 


Based  upon  our  research,  we  can  identify  six  fundamental  components  of 
logistics  maturity: 

♦  Vision  and  strategy 

♦  Organization  and  workforce 

♦  Resources 

♦  Technology  enablers 

♦  Logistics  processes 

♦  Performance. 

We  took  logistics  maturity  to  mean  the  capability  of  an  agency  to  execute  logis¬ 
tics  practices  in  a  manner  satisfactory  to  its  customers.  It  is  not  necessary  for  an 
agency  to  be  the  best  in  the  world  or  even  the  best  in  its  class  (although  that  is  al¬ 
ways  a  desirable  objective)  to  reach  the  summit  of  maturity.  We  are  mindful  that 
civil  agencies,  in  particular,  are  routinely  under  tight  personnel  and  funding  con¬ 
straints.  It  is  impractical  to  expect  them  to  be  the  leaders  in  the  execution  of  mod¬ 
em  logistics  initiatives,  but  it  is  quite  reasonable  to  expect  them  to  adopt  such 
initiatives  and  execute  them  well  enough  to  meet  the  needs  of  their  customers, 
notwithstanding  their  organizational  constraints. 

Logistics  maturity  within  an  agency  begins  with  a  clear  vision  and  articulation  of 
who  the  customers  are  and  what  they  need  in  the  way  of  support.  Coincidental 
with  the  vision  is  a  strategy  to  align  available  resources  (people,  processes,  tech¬ 
nology,  and  dollars)  to  meet  that  need.  Next,  the  people  in  the  workforce  must  be 
organized  and  given  the  training  and  leadership  necessary  to  fulfill  their  responsi¬ 
bilities.  The  workforce  also  must  have  sufficient  resources.  The  cliche,  “doing 
more  with  less,”  is  not  a  long-term  strategy  for  success. 

Finally,  logistics  maturity  must  consider  availability  and  application  of  technol¬ 
ogy  enablers,  such  as  information  systems  and  communication  devices  and  net¬ 
works  that  are  sufficiently  modem  to  do  the  job;  logistics  policies  and  processes 
that  are  documented,  understood,  and  enforced;  and  metrics  that  give  workers  and 
managers  alike  a  tme  picture  of  the  outcome  of  their  efforts. 

For  the  purpose  of  assessing  logistics  maturity  in  government  agencies,  we  devel¬ 
oped  the  following  descriptions  of  the  five  progressive  maturity  levels. 
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Maturity  Level  1 


A  maturity  level  1  organization  typieally  operates  on  an  ad  hoe  basis.  The  organi¬ 
zation  rarely  provides  a  stable  environment.  Proeesses  are  performed,  but  not  in 
aecordanee  with  set  eorporate  goals  and  objeetives.  Sueeess  in  these  organizations 
often  depends  on  the  eompetence  of  people  in  the  organization,  and  sueeess  ean- 
not  be  repeated  unless  the  same  individuals  are  assigned  to  the  next  projeet. 

At  the  initial  level  of  logisties  maturity,  an  organization  will,  at  a  minimum,  ae- 
eomplish  seven  basie  practiees: 

♦  Material  aequisition 

♦  Requirements  determination 

♦  Maintenance 

♦  Item  identification 

♦  Asset  management 

♦  Distribution  and  transportation 

♦  Material  disposition. 

Maturity  Level  2 


At  maturity  level  2,  an  organization’s  logistics  components  are  planned,  docu¬ 
mented,  performed,  monitored,  and  controlled  at  the  project  and  process  level.  To 
advance  to  level  2  of  logistics  capability,  which  we  call  managed  logistics,  an 
agency  would  be  expected  to  perform  nine  tasks  competently: 

♦  Logistics  skills  development 

♦  Asset  visibility 

♦  Functional  integration 

♦  Quality  improvement 

♦  Cost  reduction 

♦  Resource  management 

♦  Inventory  optimization 

♦  Systems  modernization 

♦  Metrics  analysis. 
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Maturity  Levels  in  Government  Logistics 


Maturity  Level  3 


At  maturity  level  3,  logistics  components  are  tailored  from  the  organization’s  set 
of  standard  processes  and  related  organizational  assets  to  suit  the  circumstances  in 
which  they  will  be  performed.  At  maturity  level  3,  processes  are  well  character¬ 
ized  and  understood,  and  are  described  in  policies,  standards,  procedures,  tools, 
and  methods. 

By  level  3,  tailored  logistics,  an  agency  practices  the  following; 

♦  Supply  chain  integration 

♦  Strategic  sourcing 

♦  Performance-based  logistics 

♦  Supplier  relationship  management 

♦  Balanced  scorecard  and  benchmarking 

♦  Customer  relationship  management. 

Maturity  Level  4 


Organizations  that  achieve  maturity  level  4  are  managing  logistics  components 
using  statistical  and  other  quantitative  techniques.  Quantitative  objectives  for 
product  quality,  customer  service  quality,  and  process  performance  are  estab¬ 
lished  and  used  as  management  criteria.  Product  quality,  service  quality,  and 
process  performance  are  understood  in  statistical  terms  and  are  managed  through¬ 
out  the  life  of  processes. 

At  level  4,  an  agency’s  organizational  focus  is  on 

♦  enterprise  integration  and 

♦  strategic  planning  and  execution. 
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Maturity  Level  5 


At  maturity  level  5,  an  organization  has  achieved  all  of  the  goals  of  the  preced¬ 
ing  maturity  levels.  Logistics  components  are  fully  integrated  and  continually 
improved  based  upon  the  organization’s  understanding  of  the  common  causes  of 
performance,  cost,  and  customer  satisfaction  variations  inherent  in  these  logis¬ 
tics  components.  Level  5,  optimized  integration,  is  the  target  end  state.  Opera¬ 
tional  excellence  is  achieved  at  this  highest  maturity  level.  Of  course,  a  lot  of 
management  attention,  resources,  and  time  must  be  expended  to  reach  level  5. 

Maintaining  level  5  status  over  time  is  equally  difficult.  Customer  needs  are  al¬ 
ways  changing,  and  logistics  organizations  must  continually  gauge  what  the 
requirements  are  and  adjust  their  attention  accordingly. 
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Chapter  5 

Our  Approach  to  a  Logistics  Maturity  Evaluator 


The  basic  functions  in  any  logistics  organization  include  material  acquisition, 
requirements  determination,  maintenance,  item  identification,  asset  manage¬ 
ment,  distribution  and  transportation,  and  material  disposition.  These  functions 
form  the  base  of  the  logistics  maturity  pyramid  (level  1)  shown  in  Figure  5-1. 

Levels  2-5  are  composed  of  improvement  practices  at  increasing  levels  of  diffi¬ 
culty,  complexity,  and  potential  benefit.  An  organization  may  perform  some  or  all 
of  the  practices  internally,  or  it  may  choose  to  serve  as  overseer  and  outsource  the 
work  to  another  government  or  private  sector  organization. 

The  core  of  the  LME  is  a  questionnaire  that  was  developed  to  help  government 
agency  executives  assess  the  maturity  level  of  their  logistics  organization  with  a 
minimum  initial  investment  of  time  and  money.  We  can  determine  an  agency’s 
logistics  maturity  by  asking  key  logistics  personnel  to  complete  the  questionnaire. 
Survey  participants  must  be  thoroughly  familiar  with  functions  and  practices 
within  their  organization. 

Figure  5-1.  Logistics  Maturity  Pyramid 


Level  1 — Initial 
(Basic  practices) 
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Logistics  managers  strive  to  move  their  organizations  up  the  pyramid  from  basic 
functions  (level  1)  to  optimized  integration  (level  5).  This  upward  movement  means 
passing  through  eaeh  set  of  improvement  praetices  identified  at  levels  2-4  to  reach 
level  5. 

Eaeh  praetice  within  a  level  must  be  performed  to  the  satisfaction  of  the  organiza¬ 
tion  and  its  eustomers  before  upward  movement  can  occur.  Specific  answers  within 
the  assessment  questionnaire  are  gauged  to  determine  this  degree  of  satisfaction. 
This  means  an  organization  eannot  jump  from  level  1  direetly  to  level  3  simply  be¬ 
cause  it  is  performing  all  of  the  level  1  functions  as  well  as  strategie  sourcing  at 
level  3.  All  the  level  2  practiees  must  be  aehieved  effectively  (e.g.,  logisties  skills 
development,  asset  visibility)  before  moving  on  to  level  3.  However,  our  assess¬ 
ment  approach  does  not  require  an  organization  to  perform  each  practice  within  a 
level  with  the  same  degree  of  eompetency.  For  example,  an  organization  may  be 
exceedingly  good  at  level  2  eost  reduetion  and  metrics  analysis,  but  only  satisfac¬ 
tory  at  quality  improvement  and  systems  modernization.  Such  an  organization 
would  meet  the  test  of  aeceptability  if  each  practice  was  being  performed  at  least 
satisfactorily. 

We  assess  an  agency’s  logistics  maturity  by  administering  the  evaluation  ques¬ 
tionnaire  to  key  logistics  personnel.  Once  agency  personnel  have  completed  the 
survey,  individual  scores  are  aggregated  and  summarized  into  an  organizational 
score.  The  scoring  system  is  constructed  so  that  no  maturity  levels  can  be  skipped. 
The  aceeptable  score  for  one  maturity  level  has  to  be  attained  before  an  organiza¬ 
tion  can  be  rated  at  the  next  higher  maturity  level. 

The  researeh  team  developed  a  list  of  evaluation  questions  for  the  questionnaire, 
with  five  possible  answers  for  eaeh  question.  Both  the  questions  and  answer 
choiees  are  weighted.  The  weight  of  eaeh  question  is  based  upon  the  level  of  the 
logistics  function  within  the  logistics  maturity  pyramid.  The  levels  are  assigned 
weights  of  1  to  5,  with  5  being  the  highest  level  of  maturity — or  the  greatest 
weight.  The  responses  are  similarly  weighted  with  the  most  mature  practiees  as¬ 
signed  a  weight  of  5. 

An  individual’s  response  to  a  question  reeeives  a  score  equal  to  the  question 
weight  multiplied  by  the  weight  of  the  ehosen  answer.  The  scores  are  averaged  for 
each  pyramid  function  and  practice  area,  then  summed  across  pyramid  areas  for  a 
final  score  for  each  logistics  component.  Scores  are  rounded  down  to  the  nearest 
whole  number  to  determine  the  maturity  level  reached  for  each  component. 

The  components  of  logisties  maturity  are  given  equal  weight,  but  an  organization 
cannot  get  eredit  for  a  maturity  level  unless  the  minimum  level  score  is  met  for  all 
components.  This  means  the  minimum  level  score  reaehed  aeross  all  eomponents 
is  the  overall  maturity  level  for  the  individual  component. 

As  an  example  of  the  scoring  process,  one  organization  could  be  assessed  at  a 
2.7  eapability  level  with  another  organization  assessed  at  a  2.1  level,  yet  both 
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organizations  are  considered  to  be  at  level  2.  The  higher  numeric  score  does 
not  entitle  an  organization  to  assume  level  3  performance.  The  organization 
remains  at  level  2  until  it  attains  a  satisfactory  score  for  all  level  3  practice 
area  requirements  before  moving  up  to  that  level. 

Of  course,  organizations  can  institute  process  improvement  initiatives  at  any  time 
for  functions  within  any  maturity  level.  Under  the  LME  assessment,  however, 
these  organizations  would  not  be  scored  at  the  higher  maturity  level  until  all  func¬ 
tions  or  practices  at  lower  levels  are  scored  as  satisfactory.  This  means  an  organi¬ 
zation  cannot  “leapfrog”  to  a  higher  level.  Such  action  works  to  the  detriment  of 
the  maturity  assessment  concept  as  it  attempts  to  improve  an  organization’s  per¬ 
ceived  score  before  the  necessary  infrastructure  is  in  place  to  support  widespread, 
permanent  improvement. 

Managers  should  understand  that  to  attempt  to  advance  prematurely  to  higher  ma¬ 
turity  levels  jeopardizes  the  stability  and  effectiveness  of  existing  improvements 
because  the  foundation  for  their  successful  institutionalization  has  not  been  com¬ 
pleted.  Our  LME  scoring  is  conservative  because  attempting  to  implement  im¬ 
provements  without  proper  foundation  may  cause  performance  failure  at  the  very 
point  they  are  needed  most — ^under  stress. 
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Chapter  6 

Maturity  Model  Assessment  Questionnaire 


One  of  the  most  diffieult  aspeets  of  evaluating  an  organization’s  maturity  status  is 
devising  an  assessment  approaeh  that  eomprehends  a  meaningful  seope  of  the 
proeess  areas  and  ineludes  understandable  and  quantifiable  evaluation  eriteria  at 
the  same  time  it  is  easily  used  by  a  broad  range  of  knowledgeable  participants. 

Under  the  classic  CMM  method,  teams  of  analysts  often  work  up  and  down  the 
chain  of  command  and  operation  to  document,  in  great  detail,  the  existing  proc¬ 
esses,  methods,  and  technologies  in  place  or  planned  for  the  organization.  Al¬ 
though  this  approach  can  yield  a  very  accurate  and  detailed  description  of  the 
level  of  activity  and  progress  in  the  organization,  it  has  the  disadvantage  of  being 
costly  and  time  consuming.  Further,  such  an  analysis  often  becomes  bogged  down 
in  the  details  of  operations  and  initiatives,  and  may  not  produce  sufficient  “big 
picture”  actionable  information. 

The  details  of  an  organization’s  existing  and  planned  improvement  efforts  ulti¬ 
mately  must  be  assessed  to  determine  the  level  of  success  and  identify  course  cor¬ 
rections  when  they  are  needed.  There  also  is  great  value — particularly  for  senior 
managers — in  knowing  the  overall  status  of  the  organization’s  processes  and  busi¬ 
ness  process  improvement  initiatives.  Such  information  is  essential  for  evaluating 
potential  improvement  alternatives  against  generally  recognized  criteria  and 
benchmarks,  particularly  as  they  are  demonstrated  in  “world-class”  organizations 
or  activities.  Having  a  formal,  useful  evaluation  process  reduces  the  subjective 
nature  of  the  decisions  and  increases  the  probability  of  selecting  business  im¬ 
provement  solutions  that  meet  the  demands  of  organizational  stakeholders  and 
customers. 

The  core  of  the  LME  is  the  questionnaire  that  was  developed  to  permit  govern¬ 
ment  executives  to  assess  the  maturity  level  of  their  logistics  organization  with 
minimal  initial  investment  in  time  and  resources.  Building  on  the  broad  range  of 
analytical  research  already  accomplished  by  LMI  personnel  over  the  past  several 
years,  our  LME  team  identified  the  basic  subject  matter  that  must  be  incorporated 
into  the  functional  scope  of  the  evaluation  tool.  This  scope  incorporates  the  func¬ 
tions,  practices,  and  improvement  areas  included  in  the  logistics  maturity  pyramid 
discussed  in  Chapter  5. 

Our  research  challenge  was  to  develop  a  mechanism  that  sufficiently  differenti¬ 
ated  a  range  of  capabilities  that  characterized  the  distinctive  level  of  maturity  or 
improvement  progress  for  each  functional  topic.  At  the  same  time,  our  evaluation 
tool  had  to  be  a  “stand-alone”  vehicle,  requiring  minimal  explanation  or  descrip¬ 
tion.  To  satisfy  these  requirements,  the  team  developed  a  173  question  survey  that 
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incorporated  the  26  functional  elements  of  our  logistics  maturity  pyramid.  The 
survey  is  multiple-ehoiee,  with  five  possible  answers  for  eaeh  question.  Answers 
range  from  A  to  E,  with  question  “A”  answers  relating  to  the  highest  maturity 
level  and  “E”  responses  relating  to  the  lowest  level  of  maturity.  Respondents  are 
advised  to  answer  questions  truthfully  and  accurately  for  their  organizational  eir- 
cumstances,  and  not  try  to  outwit  the  system. 

The  following  is  a  sample  survey  question. '  Agency  participants  in  the  EME  sur¬ 
vey  ehoose  the  answer  that  best  characterizes  their  organization. 

Our  agency’s  approach  to  reutilization  of  unneeded  equipment  and 
material  assets  is: 

A.  Our  agency  has  official  rules  and  processes  in  place  to  ensure  that 
material  no  longer  required  by  the  owning/using  organization  is  of¬ 
fered  for  reuse  to  all  other  organizations  within  the  agency. 

B.  Our  agency  has  official  mles  and  processes  in  place  to  ensure  that 
material  no  longer  required  by  the  owning/using  organization  is  of¬ 
fered  to  some  organizations  within  the  agency. 

C.  Our  agency  does  not  have  official  rules  and  processes  but  as  a 
general  practice  the  owning/using  organization  offers  material  no 
longer  required  to  all  other  organizations  within  the  agency. 

D.  Our  agency  does  not  have  official  mles  and  processes  but  as  a 
general  practice  the  owning/using  organization  offers  material  no 
longer  required  to  some  organizations  within  the  agency. 

E.  Our  agency  has  not  issued  material  disposition  guidance,  either 
officially  or  unofficially. 

Evaluating  the  LME  Assessment  Results 


As  described  earlier,  an  EME  assessment  is  equally  useful  in  focusing  management 
attention  on  specific  process  improvement  target  areas  and  assessing  the  overall 
maturity  level  across  an  organization’s  full  range  of  logistics  processes.  By  summa¬ 
rizing  the  results  of  the  EME  questionnaire,  we  can  document  for  agency  managers 
the  status  of  awareness,  priority,  and  implementation  of  a  series  of  widely  accepted 
process  improvement  initiatives  across  the  full  spectmm  of  common  logistics  func¬ 
tions.  This  documentation  captures  the  collective  knowledge  and  experience  of  the 
logistics  practitioners  within  the  organization  being  assessed. 

To  ensure  a  valid  evaluation  of  an  agency’s  logistics  maturity  level,  the  EME 
process  follows  a  series  of  steps  that  foster  full  understanding  of  the  process  and  a 
disciplined  execution  of  the  evaluation  mechanism. 


*  A  copy  of  the  full  survey  questionnaire  is  provided  under  Appendix  A.  The  automated  LME 
product  is  on  the  CD  enclosed  with  this  report. 
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Preliminary  Contact  with  Agency  Personnel 

As  part  of  the  LME  process,  LMI  personnel  make  initial  contact  with  senior 
agency  managers  to  explain  the  concept,  process,  and  expected  benefits  of  our 
logistics  maturity  evaluator.  An  initial  briefing  acquaints  senior  managers  and 
other  appropriate  agency  staff  with  the  LME  approach  and  elicits  their  feedback 
regarding  the  applicability  and  need  for  such  an  evaluation  at  that  agency. 

The  agreement  between  LMI  and  agency  management  is  formalized  in  a  letter  of 
understanding  (LOU)  that  documents  the  relationship  and  responsibilities  of  the 
participating  parties.^  Agency  managers  are  then  asked  to  complete  a  preliminary 
survey  to  help  determine  the  basic  profile  of  the  logistics  organization,  re- 
sources,  and  processes.  After  evaluating  this  profile,  LMI  works  with  the  agency 
to  identify  a  number  of  key  logisticians  who  represent  the  organization’s  most  sig¬ 
nificant  logistics  activities  (such  as  mission  critical  logistics  providers  or  high  dol¬ 
lar  programs)  to  participate  in  the  LME  evaluation  session.  LMI  personnel  then 
meet  with  the  potential  recipients  of  the  LME  survey  to  make  them  aware  of  the 
purpose,  required  actions  and  how  the  LME  results  will  be  provided  to  the 
agency.  Considerations  such  as  nondisclosure,  anonymity,  confidentiality,  and 
potential  uses  of  the  evaluation  results  are  addressed. 

Using  the  Questionnaire 

Agency  senior  managers  approve  the  application  of  the  LME  and  identify  personnel 
who  will  be  tasked  to  respond  to  the  LME  assessment  questionnaire.  LMI  personnel 
oversee  the  completion  of  the  LME  questionnaire,  which  can  be  administered  at  the 
agency  worksite  or  at  an  LMI  facility,  depending  on  the  preference  of  agency 
management. 

The  questionnaire  is  automated  to  facilitate  both  the  entry  of  responses  by  agency 
personnel  and  the  tabulation  of  scores.  The  LME  tool  actually  is  a  system  of  data¬ 
bases.  Responses  are  collected  from  participants,  and  the  central  database  or¬ 
ganizes  the  responses  and  aggregate  results  for  different  groups.  The  LME  tool 
collects  each  participant’s  answers  in  a  Microsoft  Access  database.  Because  the 
form  opens  automatically,  the  inner  workings  of  the  database  are  transparent  to 
participants. 


^  An  example  of  this  LOU  is  provided  as  Appendix  B. 
^  A  eopy  of  this  initial  survey  is  at  Appendix  C. 
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Each  user  follows  a  series  of  simple  steps  to  eomplete  the  survey: 

♦  Enter  ageney,  department,  and  job  title  (for  traeking  purposes). 

♦  Choose  the  appropriate  answer  for  eaeh  question  using  the  radio  buttons 
labeled  A  through  E.  The  questions  are  numbered  and  organized  aeeording 
to  the  logisties  maturity  pyramid. 

♦  Navigate  through  the  list  of  questions  using  the  arrows  at  the  bottom  of  the 
form. 

♦  Cliek  the  “Survey  Complete”  button  when  finished. 

♦  Cliek  the  stop  sign  button  to  exit  the  survey  before  all  questions  have  been 
answered. 

♦  Cliek  the  “Print  Your  Responses”  button  to  print  a  report  showing  the 
questions  and  answers  seleeted. 

♦  Cliek  “Exit  EME”  to  exit  the  tool. 

The  responses  are  saved  in  a  table  within  a  separate  database,  and  the  seores  are 
ealeulated. 


Scoring 


Onee  all  questionnaires  are  eompleted,  manually  entered  forms  (if  used)  are  tran- 
seribed  into  the  automated  system  for  tabulation.  The  results  are  then  scored  and 
summarized,  as  deseribed  in  Chapter  5. 

All  responses  to  the  EME  questionnaire  are  eompiled  in  a  eentral  database,  whieh 
organizes  responses  from  multiple  individuals  and  reports  results  aeross  and 
within  groups  (for  example,  ageneies  or  departments).  A  table  eontaining  the 
seores  from  eaeh  questionnaire  is  then  linked  to  this  eentral  database.  Onee  the 
individual  responses  are  averaged,  reports  and  graphs  ean  be  displayed. 

Summary  Assessment 


After  seoring  is  eomplete,  the  eomputed  results  are  formatted  into  a  report  for 
presentation  to  ageney  offieials.  EMI  eompiles  and  analyzes  survey  responses  to 
determine  the  status  of  improvement  praetiees  within  the  logisties  eomponents, 
quantify  the  organization’s  logisties  maturity,  and  ereate  an  organizational  logis- 
ties  maturity  evaluation  profile.  Results  are  eompared  to  those  of  similar  ageneies 
or  matehed  to  private  seetor  experienee.  The  final  report  to  ageney  managers  in- 
eludes  summaries  of  responses  by  logisties  praetiee  and  other  groupings,  key  eon- 
elusions,  and  suggestions  for  next  steps. 
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Maturity  Model  Assessment  Questionnaire 


Consistent  with  the  CMM  concept  discussed  earlier,  the  LME  process  produces 
an  overall  figure  that  graphically  represents  the  composite  ranking  of  the  target 
logistics  organization  on  the  maturity  level  1-5  scale.  Scores  are  compiled  for 
each  of  the  six  components  of  logistics  maturity  and  an  overall  maturity  level  as¬ 
signed.  As  Figure  6-1  illustrates,  agency  management  can  easily  see  their  total 
maturity  level  score  and  the  corresponding  highs  and  lows  that  affect  their  overall 
ranking. 


Figure  6-1.  Sample  Composite  Ranking  of  Logistics  Maturity 
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Chapter  7 

Results  of  IR&D  Project  and  Future  Plans 

Results 


The  LME  development  team  eompleted  the  initial  phase  of  the  researeh  effort  and 
produeed  a  working  version  of  a  logisties  maturity  analytieal  assessment  tool.  The 
LME  was  developed  for  use  by  senior  logistics  managers  in  government  agencies 
who  desire  an  initial  assessment  of  the  status  of  their  ongoing  organic  or  con¬ 
tracted  logistics  support  programs  and  initiatives. 

As  described  earlier,  the  LME  builds  on  the  concept  of  the  CMM  developed  by 
Software  Engineering  Institute  of  Carnegie-Mellon  Elniversity.  The  LME  is  a 
streamlined  version  of  the  CMM  approach;  it  uses  a  comprehensive  questionnaire 
to  obtain  information  from  key  logistics  personnel  in  the  government  activity  be¬ 
ing  assessed.  This  evaluation  approach  uses  the  inherent  expertise  of  agency  per¬ 
sonnel  to  document  the  logistics  maturity  of  the  organization. 

The  assessment  questionnaire  was  compiled  based  on  the  collective  logistics  experi¬ 
ence  and  knowledge  of  the  EMI  development  team.  It  covers  the  full  spectrum  of  lo¬ 
gistics  functions  and  best  practice  initiatives  from  both  government  and  the  private 
sector.  Questionnaire  responses  are  weighted  based  on  criteria  developed  for  the  pro¬ 
ject  to  determine  the  maturity  level  for  each  logistics  area  and  the  results  are  arrayed 
for  the  26  areas  characteristic  of  logistics  organizations. 

Selected  agency  personnel  may  complete  the  questionnaire  using  an  automated 
system  or  hard  copy.  Results  are  then  summarized  and  documented  graphically 
for  presentation  to  senior  agency  officials. 

Future  Plans 


As  we  approached  Phase  II  of  our  work — the  application  of  the  LME — we  were 
encouraged  in  our  informal  conversations  with  several  Department  of  Homeland 
Security  (DHS)  managers  who  indicated  they  would  be  interested  in  testing  LME. 
The  department’s  logistics  operations  consist  of  a  patchwork  of  legacy  processes 
and  systems  representing  the  22  different  federal  organizations  that  were  brought 
under  the  new  DHS  organization  created  by  Congress  in  November  2002. 

It  is  not  surprising  that  the  processes  and  systems  of  the  22  DHS  organizations — 
which  were  developed  independently — are  not  integrated.  Although  logistics  has 
not  been  consistently  defined  at  the  departmental  level,  it  is  the  commonly  applied 
label  for  material  management  processes  and  systems  throughout  DHS. 
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Still,  DHS  has  no  consistent  way  of  evaluating  the  overall  logistics  process  com¬ 
ponents.  As  is  true  in  a  number  of  civil  agencies,  logistics  is  defined  differently  in 
eaeh  DHS  organization,  and  some  organizations  do  not  have  a  separately  struc¬ 
tured  logistics  element,  even  though  the  ageney,  as  a  whole,  has  signifieant  logis- 
ties  responsibilities.  The  scope  of  logistics  may  vary  from  administrative  support 
at  headquarters  level  to  major  warehousing  and  repair  aetivities.  Therefore,  it  is 
often  impossible  for  managers  to  know  which  areas  require  particular  attention. 
Further,  managers  need  to  know  whieh  of  the  seemingly  similar  proeesses  and 
systems  are  more  advanced  and  capable  than  the  others,  and  which  should  be 
revamped  or  retired  and  replaeed. 

The  LME  team  is  pursuing  another  opportunity  to  test  the  LME  with  the  Eederal 
Supply  Serviee  of  the  General  Services  Administration.  This  organization  has 
numerous  logistics  improvement  initiatives  underway  and  appears  to  be  a  viable 
target  for  demonstrating  the  value  of  the  EME  as  an  assessment  tool.  The 
EME  development  team  plans  to  continue  to  pursue  opportunities  to  validate  the 
tool  in  several  target  civil  agencies. 
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Appendix  A 

Logistics  Maturity  Evaluator  Survey 


We  developed  a  eomprehensive  LME  questionnaire  to  help  government  exeeu- 
tives  assess  the  maturity  of  their  logisties  organization.  The  ehallenge  was  to  de¬ 
velop  a  survey  that  suffieiently  differentiated  between  the  capabilities  that 
characterize  each  level  of  maturity. 

The  resulting  evaluation  tool  is  a  “stand-alone”  vehicle,  requiring  minimal  expla¬ 
nation  or  description.  There  are  173  questions  that  incorporate  the  26  functional 
elements  of  our  logistics  maturity  pyramid.  Survey  participants  choose  among 
five  possible  answers  (A  to  E). 

Respondents  are  advised  to  answer  questions  truthfully  and  accurately  for  their 
organizational  circumstances,  and  not  try  to  “outwit”  the  system. 
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Appendix  B 

Letter  of  Understanding 


The  attached  letter  of  understanding  (LOU)  between  LMI  and  an  agency’s 
management  formalizes  the  relationship  and  responsibilities  of  the  participating 
parties. 
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LMI 

GOVERNMENT  CONSULTING 


[Click  here  and  type  date] 


[Click  here  and  type  reeipient’s  address] 

Dear  [Cliek  here  and  type  reeipient’s  name]; 

The  purpose  of  this  letter  of  understanding  is  to  deseribe  how  LMI  will  conduct  the  Logistics 
Maturity  Evaluation  (LME)  of  selected  Department  of  Homeland  Security  (DHS)  agencies. 
Below,  we  outline  the  evaluation  approaeh  and  our  expeetations  for  the  partieipants. 

Participation  is  voluntary  and  at  no  cost  to  DHS  or  the  participating  agencies.  This  effort  is 
funded  wholly  by  EMI’s  independent  research  and  development  funds. 

Nondisclosure 

The  information  gathered  from  the  Eogistics  Maturity  Assessment  Questionnaire  is  intended 
solely  for  the  purpose  of  aiding  in  the  design  of  the  Logisties  Maturity  Evaluation.  Survey 
responses  will  be  kept  eonfidential,  will  only  be  shared  with  EMI  personnel  with  a  need  to  know, 
and  will  not  be  shared  with  any  non-EMI  party.  EMI  will  not  disclose  the  source  of  the  survey 
responses. 

LME  Approach 

Background 

An  objective  maturity  evaluation  of  organizational  logisties  ean  offer  distinct  advantages  to 
managers  trying  to  achieve  higher  service  levels  from  their  logistics  processes.  The  appraisal  can 
inform  operational  decision-making,  focus  management  emphasis,  and  align  organizational 
resources.  EMI  developed  the  EME  to  provide  executives  with  an  enterprise  view  of  how  their 
logistics  operations  eompare  to  a  set  of  generally  accepted  improvement  practices.  The  EME  is 
based  on  research  of  current  maturity  evaluation  methods  and  logistics  best  practices.  The  EME 
is  a  struetured,  high-level  diagnostie  tool  whieh  is  used  to  assess  a  Government  organization’s 
logistics  capability  and  identify  target  areas  for  performance  improvement  and  reduced  support 
costs.  EME  can  particularly  benefit  government  organizations  with  equipment-dependent, 
readiness-oriented,  logistics-reliant  operations. 

The  LME  eonsiders  a  mix  of  organizational  eomponents  that  serve  as  a  logisties  framework: 

•  Vision  and  strategies 

•  Organization  and  workforce 


2000  CORPORATE  RIDGE  .  McLEAN  .  VA  22  102-7805  .  T  703.9  1  7.9800  .  F  703.9  1  7.7597  .  www.lmi.org 


Resources 


• 

•  Technology  enablers 

•  Logistics  processes 

•  Performance 

Individual  logistics  components  can  be  assessed  against  a  maturity  scale  to  identify  stages  of 
development  and  improvement  practices  needed. 

Methodology 

1 .  LMI  will  present  a  briefing  describing  the  LME  assessment  process. 

2.  LMI  will  administer  a  preliminary  survey  to  gather  key  organizational  characteristics, 
including: 

■  key  missions  and  activities 

■  mission  critical  equipment 

■  logistics  organization  structure(s) 

■  agency  budget 

■  logistics  activity  funding 

3.  Based  on  evaluation  of  this  profile,  LMI  will  work  with  the  agency  to  identify  five 
logisticians,  representing  the  organization’s  five  most  significant  logistics  activities  (e.g. 
mission  critical  logistics  providers  or  high  dollar  programs),  to  attend  a  one-day  session 
to  complete  the  LME  survey. 

Scoring  and  Analysis 

EMI  will  compile  and  analyze  survey  responses  to  determine  the  status  of  improvement  practices 
within  the  logistics  components,  quantify  the  organization's  logistics  maturity,  and  create  an 
organizational  Eogistics  Maturity  Evaluation.  Results  will  be  compared  with  those  from  similar 
agencies  to  derive  key  conclusions  and  suggest  next  steps. 

LMI  Responsibilities 

EMI  will 

•  administer  the  EME  to  the  agencies  in  this  agreement  at  no  cost. 

•  provide  the  evaluators,  materials  and  information  systems  necessary  to  conduct  this 
evaluation. 

•  provide  a  complete  debriefing  of  the  results  of  the  evaluation  to  the  participating  agency. 
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Agency’s  Name 

Agency  will 


•  provide  the  pre-survey  information  to  the  LME  evaluators. 

•  provide  at  least  five  management  representatives  from  the  most  signifieant  logistics 
activities  to  take  part  in  the  evaluation. 


If  you  have  any  questions  about  the  LME  during  the  evaluation  or  want  to  discuss  the  results, 
please  contact  Jeff  Colaianni  at  (703)  917  7548,  jcolaian@lmi.org. 

We  appreciate  the  opportunity  to  help  DHS  and  its  agencies  to  optimize  their  logistics  programs. 


Sincerely, 


Jeffery  P.  Bennett 
Operating  Vice  President 
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Appendix  C 

Initial  LME  Survey 


Agency: 

Interviewee: 

Office: 

Position: 

Grade: 

1 .  What  is  the  annual  budget  in  your  ageney? 

2.  Is  there  a  speeifie  budget  for  logistics?  What  is  the  annual  budget 
for  logistics? 

3.  Who  at  the  executive  level  is  in  charge  of  logistics? 


4.  What  general  types  and  number  of  equipment  do  you  support? 


0-100 

items 

100-500 

items 

500-1,000 

items 

>1,000 

items 

Vehicles 

Boats 

Aircraft 

Major  inspection  equipment 

Sensors 

Radio  equipment  (C4) 

Maintenance  significant  weapons 

IT  equipment 

Other 
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5.  Do  you  have  an  agency-wide  logistics  office? 


•  Who  does  this  office  report  to? 

•  What  mission  critical  equipments  does  it  support? 

•  How  many  staff  does  it  have? 

•  What  is  the  approximate  annual  budget? 

•  Are  they  following  major  logistics  functions  outsourced?  (Y/N) 

o  Supply 
o  Maintenance 

o  Distribution  and  transportation 


6.  Is  logistics  performed  in  other  offices? 


Office 

Outsourced 

(Y/N) 

Equipment 

supported 

Number  of 
staff 

Approximate 
annual  budget 

Supply  (Y/N) 

Maintenance 

(Y/N) 

Distribution  and 
transportation 
(Y/N) 

If  you  have  any  questions  contact  Jeff  Colaianni  at  (703)  917-7548  orjcolaian@lmi.org. 
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